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Stochastic thermodynamics (ST) summarizes recent advances in nonequilibrium statistical me- 
chanics of systems featuring local thermodynamic equilibrium. However, the mathematical descrip- 
tion of ST is largely independent of this thermodynamic context. Here, we introduce novel network 
multibaker maps as a model system for reversible, chaotic dynamics. As a result, the mathematical 
formalism of ST emerges from information theory, and is shown to be consistent with previous work. 
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Introduction Stochastic thermodynamics (ST) is a re- 
cent approach to the statistical mechanics of nonequilib- 
rium systems pQ. Using both random variables and en- 
semble properties it extends the notions of entropy and 
entropy production to stochastic trajectories [21 [3]. Using 
the notion of time-reversal, ST provides elegant deriva- 
tions [1] of stochastic fluctuation [51(5] and work relations 
[5] . It also yields universal results on thermodynamic 
efficiency of small machines and the conversion of in- 
formation to work |101 lllj . Moreover, advanced experi- 
mental and simulation techniques allow direct testing of 
these theoretical results [T2HH]- ST relies on a thermo- 
dynamically consistent interpretation of the stochastic 
process within a framework of an assumed thermody- 
namic local equilibrium. Surprisingly, the mathematical 
formulation of ST seems not to depend on the specific 
physical context [T5J [TB] . What is needed is the Markov 
property of the dynamics, though for certain relations 
even this assumptions can be relaxed |17j . 

In this work, we introduce the notion of network multi- 
baker maps (NMBM) and take a dynamical system's per- 
spective on ST. Multibaker maps serve as a paradigm for 
studies on the relation of microscopic dynamics, statis- 
tical physics and transport phenomena [TH1 Qj|]. They 
fulfill many of the generic features of chaotic dynamics: 
Reversibility, hyberbolicity, homo- and heteroclinic or- 
bits, a natural Markov partition and ergodicity [2TH |2"T] . 
Yet, their simple structure admits an explicit calcula- 
tion of the evolution of ensembles which are represented 
by non-stationary phase-space densities [T51122]- Here, 
we explicitly calculate the full evolution of information- 
theoretical quantities for NMBM. We distinguish three 
fundamental contributions, which are in one-to-one cor- 
respondance to the entropy expressions used in ST. Fur- 
ther, we show that our approach is consistent with pre- 
vious work based on phase-space contraction [221 [21] • 

Network multibaker maps Let Q = (V,£) be a con- 
nected graph with N vertices i € V := [1, 2, . . . , N] and 
edges e € £ C V x V. Vertices represent the funda- 
mental states of some effective (for instance, thermody- 
namic) description. Edges indicate possible transitions 
between these states. We assume bi-directional edges, 
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FIG. 1. Dynamics of the network multibaker map. For each 
of the ki neighbours vertices j G Vj of vertex i, a horizontal 
strip Cj C Ci of relative height sj is affine-linearly mapped to 
a vertical strip Cj C Cj of width si . 

i.e. e := G £ e :— G £, and that each 

vertex is connected to itself, i.e. (i,i) G £, Vi G V. Let 
V» := {j £ V : G £} be the set of vertices that are 
connected to a state i. Denote by fcj := |Vj| the degree of 
vertex i. Associate with each vertex i a rectangular cell 
Ci := [0, 1] x Ilj • [0, 1] with area (Lebesgue measure) 
consisting of the set of phase-space points x G Ci which 
belong to state i. The overall phase space T of the system 
is the disjoint union V := uf =l Ci. 

A NMBM, $ : V — > V, deterministically maps phase- 
space points to adjacent cells. It is specified geometri- 
cally (c/. Fig.JT]) by dividing each cell Ci into fc, horizon- 
tal strips of finite relative height s* > 0. More precisely, 
with the offset bj — J2k<j s l- : 

i _/[0,l]xn i -[6},6} + 4) teVjeV,, 
J "~\0 ' else. [) 

The dynamics maps each horizontal strip Cj C Ci to a 
vertical strip Cj := <I>Cj C Cj in an affine-linear way: 

CJ:=[6},6} + S})xn,.[0,l] (2) 

Analogously, sj denote the relative width of the vertical 

strips and the offsets read 6* = J2k<i Points in any 
strip are mapped affine-linearly, such that the horizontal 
direction is contracted by a factor sj < 1 whereas the 
vertical direction is expanded by a factor (sj) _1 > 1. 
The multibaker map is fully defined by specifying Q and 
the numbers n^, s* and s*. 

In deriving fluctuation relations in both stochastic and 
deterministic dynamics, one applies a natural notion of 
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FIG. 2. The multibaker dynamics feature a volume preserv- 
ing involution X, cf. Eq. |5|, which interchanges horizontal 
and vertical stripes in one cell, i.e. TC) = C\ The dynamics 
<E> is reversible, but generally not volume preserving. 



time-reversal [3] [6j [23] [25] which has its origins in the 
time-reversibility of fundamental physical laws. Follow- 
ing Ref. [26] we are interested in dynamics with a trans- 
formation I on r which a) is an involution, b) preserves 
phase-space volume |-| and c) facilitates time-reversal: 

X o X = id, (3a) 

\T~ l A\ = \A\ , VA c T, (3b) 

$ _1 a;=(Io$oI)^ VaiGT. (3c) 

Properly thermostatted multibaker maps 26 obey 

= V*, j, (4) 

such that Eq. ([3| is fulfilled by the involution [18] 

X : (Z, y)^(l- U^y, IT 4 (1 - x)), V(x, y) e d, (5) 

which additionally is local each cell (cf. Fig.[2|, i.e. 

XC i =C il 'ii (6) 

With the gener al definition C) := QCidCj, Eq. Q follows 

solely from Eqs. ^ and (JsJ) , which ensure that C* and C\ 
are interchanged by the involution (cf. Fig. [2]). 

Densities and trajectories In statistical physics, the 
probability of finding a system at some point x 6 T is 
given by a time-dependent ensemble measure. We as- 
sume that this ensemble is absolutely continuous with 
respect to the Lebesgue measure, i.e. it is characterized 
by a phase-space density g( u '(x), where the superscript 
M indicates discrete time. This phase-space density 
evolves according to $ and generically develops an in- 
tricate structure as the number of iterations increases. 
Practically, preparation and resolution of phase-space 
densities is restricted to a coarse-grained level, which 
is represented by the vertices of Q. Hence, we define a 
coarse-grained density p^ v \x) to take the average value 
of on cellC,: 



» 



ur 1 / e ^\x)dx, 



(7a) 
(7b) 



where \i is the characteristic or indicator function of 

Due to the preparation procedure, fine- and coarse- 
grained ensembles agree initially, i. e. (x) = p^ (x) . 
To follow the evolution of q(°> to (f u > we introduce tra- 
jectories w as (y + l)-tuples with entries ujk € V: 



uj := (wq,o;i, . . .,u u ) 



(8) 



The entry uik denotes the vertex visited at time k. Hence, 
a trajectory is a finite string of a the symbolic sequence 
associated with the (natural) Markov partition [27] . 

Let the set C [w] denote all phase-space points that 
move together along a fixed trajectory uj_ and hence reside 
in cell C Uu at time v. Denoting by uA h > the first k < v 
steps of lo, we define recursively: 

C[w {k) ] := $(C\cJ- k -V] HQ" 1 ), VO < k < v, (9) 

where C := C Uo . One can easily verify that 

C[a/ fc-1 )] is a vertical strip. Intersecting with the horizon- 
tal strip C^k 1 reduces its volume by a factor s^t' 1 < 1- 
Through contraction and expansion in horizontal and 
vertical directions, respectively, $ changes the volume 
by another factor s^T 1 / sZ'l' 1 ■ Hence, \C [lo^] \ = 
SulT 1 \C [u/ k ~~ 1 ' > ] | and after iteration to k = v, 



H, 
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k=l 



H, 



n 

k=l 



(10) 



where for the last equality we used Eq. Q. 

Because the initial microscopic density g(°> is uniform 
on each cell, so is the density on C[lo] for any lo. Denote by 
g[co; k] the density on the (v — k)t\i pre-image $> v ~ h C[iJ\. 
Probability conservation and uniform contraction imply 



where we introduced the contraction factor 



n„ 



n 



(ii) 



(12) 



Iterating this condition, we find with Eq. Q that the 
density g^ u \x) at a point x with history lo(x) obeys: 



g {v) (x) = g [w(x) ; v] = p^ J • 



fc=i 



(13) 



Integrating g(x) over a cell Hj yields the probability 



Ik) 



qW{x) dx =Ui P f\ (14) 
which evolves according to the Master equation [27j 



Pi 



E [pf- 1 



(15) 



This establishes the connection to Markov chains and 
hence the (discrete) formulation of ST [3] . 
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Information and entropy The Shannon entropy 
of a probability density g(x) on T is defined as 



S[g] 



g log g dx. 



(16) 



With the results ( 10 1 and ( 13 ) we can calculate the fine- 



grained entropy of g^ v '(x) as a sum over all trajectories 
oA") of length v weighted with IC^")]! 
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x (£>[w;H lo ge[w;^]) 



E 



where 



j] iogn^-iogpW-^i?^ 



^=1 



- n(0) 



fc=l 



n 



^ := log (4/^) 



(17) 

(18) 
(19) 



Similarly, we find 



>)] = £ [p^M] (logH^ - logpW 



(20) 



Trajectory Junctionals The forms of Eqs. (17) and 



(|20|) suggest to write them as weighted averages of tra- 

(21) 



jectory functionals s[w; u],i.e. : 

(( s )) M = ^[py s [^ ;i , 



With that we can write si^ = 



is 



and S, 



,{ s cg)) v ' ■ where the functionals 

Sfg [w, f] = s in t [w, i/] + s v is [w, 0] - s mot [w, i/] , (22a) 
S cg [W, I/] = S int [oj, v] + s vis [w, I/] , (22b) 

are linear combinations of three fundamental functionals: 



Sint[w, v] = s hlt (uj„) = logH^, (23a) 
Svis[^, v] = s viB (oj u , v) = - logp^j, (23b) 

s mot [w, i/] = s mo t y = ^ B^- 1 ■ (23c) 
fc=l 

Note that the functionals s mt and s v - ls depend on the 
final state ui v of the trajectory only, i.e. s[w; v\ = s(w„; v). 
Hence, we say they have a local form. Trajectory averages 
of local forms reduce to ensemble averages via Eq. (|15[) : 



(s)) M = (s^ — 



(24) 



Henceforth, we regard NMBM as a model for ther- 
mostatted reversible dynamics [29]. The Markovian de- 



scription (151 for the coarse-grained ensemble on the dis- 



crete state establishes the connection to ST. 

The intrinsic entropy Si„t accounts for the entropy 
of the unobservable microscopic configurations. In the 
present dynamical context it is calculated a la Boltz- 



mann as the logarithm of a phase-space volume (23a I. 



In the thermodynamic context, it is the entropy of the 
local equilibrium ensemble which reflects the state of the 
environment |15j . Hence, the intrinsic entropy can be 
considered a "state variable" and in this respect is clos- 
est to standard thermodynamics. 

The entropy that is operationally accesible in exper- 
iments is the visible entropy s v - ls . It only depends on 
the present ensemble, i.e. the p " , which can be sampled 
by performing many measurements on identical systems. 
Though it has local form and averages can be calculated 



with Eq. (24), it depends on the ensemble and hence is 



not a state variable. 

The conceptually most difficult term is the third func- 
tional, s mo t related to the quantity In analogy to 
the electromotance for electrical circuits [30], we call 
the motance of a transition i — > j. Physically, a finite 
motance arises from a system-environment interaction. 
Unlike the affinity A* — logos' ./(Pjsl)), the motance 
Bj only depends on the dynamics and not on the en- 
semble [31] . Consequently, we call s mo t the accumulated 
motance. 

Entropy variation and production For each funda- 
mental functional s[lj, v] there is an associated funda- 
mental variation a[uj, v\ := s[lj, v\ — s[u/" _1 ), v — 1]. The 
fundamental variations 

(Tint [y, v\ = l°g n w „ - log n a)l/ _ 1 , (25a) 
o- vis [u,, u] = - logpW + logp|>:?, (25b) 
<Tmotfc,H =Kr 1 (25c) 



can be used to construct the previously known funda- 
mental forms of entropy variation |31j : 

Csys [w, U] = CTint [co, v\ + cr vis [u, v\ , (26a) 
ftot t^' v \ = CTvis fe' v \ + ^not [w, v] , (26b) 
<Tmcd [w, V] = (Tmot [w, u] ~ cr int \u, v\ . (26c) 

The system entropy variation cr sys is equivalent to the 
change of coarse-grained entropy. It consists of the visible 
entropy of the ensemble and the intrinsic entropy of the 
current state. Often, the latter is forgotten [T5] . 

We can write the average of the total entropy produc- 
tion CTtot as a Kullback-Leiber divergence, 



«*tot» 



W) _ 



E 



M i , Pi S j 

Pi ^}log^^- 

p) s i 



>o, 
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which is always positive. It is the temporal variation 
of the difference ((s cg — Sf g )), which itself is a Kullback- 
Leibler divergence. It characterizes the information gain 
of the microscopic over the coarse-grained density. Its 
positive variation (i.e. its monotonous growth) reflects 
the fact that one cannot resolve the ever-refining features 
of the microscopic density. 

The entropy change in the medium <7 me d consists of a 
motance and an intrinsic part. It has been understood 
that the latter is important for a consistent thermody- 



namic interpretation [HQS]. From Eqs. (19) and (12) we 
see that it is directly related to phase-space contraction: 



Cmcd [w] = log ■ 



- log 



IT 



IT 



(27) 



For maps, the phase-space contraction per unit time, A = 
log J 32 , 33 , is given by the logarithm of the Jacobian 
determinant J = | | f the dynamics. In the current 
affine- linear case, J\ x = i$l~ x f° r % G C^t^ 1 ■ 

Connection to the continuous description For us, 
NMBM serve as a model for a stroboscopic observa- 
tion of physical dynamics with a time lag r b s - How- 
ever, stochastic thermodynamics is usually formulated 
using continuous-time Markov processes rather than 
Markov chains. In the continuous time limit, the Mas- 



ter equation (15) becomes a differential equation pi(t) 



J2j W-Pj (t) . Its infinitesimal generator Wf consists of 
transition rates w*, which can be thought of as the 
Tohs — > limit of transition probability divided by r b s - 
The continuous-time versions of the fundamental entropy 
and variation functionals have been identified previously 
[3]. They resemble the discrete-time functionals with 
substituted by Wj and finite-time variations substituted 
by derivatives. However, there are some subtleties to be 
taken care of. Firstly, in the continuous-time description, 
the measure P[o>] of a finite trajectory is zero and sum- 
ming over trajectories involves integration over stochastic 
jump times. Secondly, in the present case, the average 
value ((<j)) {u) = ((s[u, v] - s^" 1 ) , v - \])) {u) of a varia- 
tion is the same as the change in one time-step of the av- 
eraged entropies, ((s)) ^ — ((s)) v ~ 1 . This does not apply to 
the continuous-time case, because averaging and taking 
the time-derivative do not commute for non-stationary 
probabilities. Hence, temporal boundary-terms need to 
be attributed for. Thirdly, we can rewrite the average 
total entropy production in the following form: 



(Wot)) 



(«0 



E 

hi 



(") 



s) log 



Pi s) 
O) i 



E 



(f+i) i 

Pi log 



p 



(") 



0+1) 



p 



Substituting by Wj in the first term, one obtains the 
familiar term used in the continuous-time case, which is 
already a Kullback-Leibler divergence on its own. How- 
ever, for the discrete-time case the second term is needed 
to account for the change of the ensemble between two 



jumps. It vanishes for r b s — ► because p. 



P 



Phase-space preserving systems Finally, we demon- 
strate the consistency of our approach in the context of 
phase-space preserving maps. From the dynamical sys- 
tems perspective, we consider such maps as stroboscopic 
pictures of a Hamiltonian dynamics. Thermodynami- 
cally, a Hamiltonian system is an isolated system which 
does not exchange energy, particles or entropy with its 
environment at any time. Its steady-state distribution is 
microcanonical, i.e. uniform on phase space. In stochas- 
tic terms, the steady state of an isolated system features 
detailed balance |31j for the steady-state distribution p°° : 



Pi 



p? <s\. 



(28) 



Henceforth, we assume Eq. (28) and reversibility, Eq. Q, 
to show that the interpretations are consistent. Defini- 



tion (14) directly yields s) 



CijUj with some constant 



Because J2j = 1, Vi, it follows that Cji = 1, 
Vi,j. With p\ denoting the iterated values of the proba- 
bilities pi in Eq. (jl5h , we hence find 



'{Pmed)) = E 



i -J 



Pis) log -4 



^K^-P,) log IT] 

i 

= ^2 \piUj log Uj - piUj log Hi - pjiii log n^] 
+ \pi log IT] = J2 K-ft + Pi) lQ g n *)l = °- 

i i 

Hence, the average entropy change in the medium — 
which equals the average phase-space contraction — 
identically vanishes for all times and independent of the 
initial ensemble, as is expected. 

Summary and outlook We have shown how for 
NMBM the functionals of stochastic thermodynamics 
emerge from information theory without relying on ther- 
modynamic assumptions. We presented interpretations 
of the different notions of entropy and entropy variation, 
which are consistent both with information theory and 
work on non-phase-space preserving "thermostatted" dy- 
namics. 

In analogy to the role of Smale's horseshoe [34] as 
a hallmark of chaos, NMBM could hence help under- 
standing salient features of reversible chaotic dynamics 
and their connection to thermodynamics. A possible ap- 
proach in that direction is to treat the NMBM vertices as 
linearizations of fundamental structures in such dynam- 
ical systems. Then, a coarse-graining procedure under 
the assumption of separation of scales, in the spirit of 
Ref. [IS] could yield a better dynamical picture of local 
equilibrium. 

The authors are indebted to A. Wachtel, J. Horowitz 
and L. Rondoni for illuminating discussions. 
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